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(54) Method and apparatus for providing OSD data for OSD display in a video signal having an 
encoded format 



(57) TVs and other consumer electronics devices 
tike VCRs and DVD players use on-screen display of 
messages. For display together with MPEG encoded 
video signals the picture content of an OSD text or 
graphic is stored in a non-votatile memory in a specific 
format: the OSD text or graphic content is divided into 



macroblock units and the OSD macroblock data are 
stored in MPEG encoded form in the memory. The OSD 
macroblocks to be displayed are then handled as a 
slice. 
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Description 

[0001] The invention relates to a method and to an 
apparatus for providing OSD data for OSD display in a 
video signal having an encoded format. 

Background 

[0002] TVs and other consumer electronics (CE) 
devices tike VCRs and DVD players use on-screen dis- 
play (OSD) of messages intended for making the control 
of the TV's operation parameters more convenient for 
the user. Also, a subtitling feature is desirable. 
For such purposes an additional hardware is required 
for visualising e.g. user commands. This hardware 
includes a video memory and a video mixer. The video 
memory stores the OSD text or graphic to be displayed. 
For display, the video mixer combines the stored OSD 
text or graphic with the pictures of the program currently 
broadcast or replayed. 

Invention 

[0003] Some CE devices like Set- Top Boxes or DVD 
players already include an MPEG decoder according to 
the ISO/lEC standards 11172 and 13818. Such MPEG 
decoders are available as chips, e.g. the MPEG2 
decoder IC STi3520A of SGS-Thomson. In connection 
with such devices it is possible to omit for OSD pur- 
poses the above mentioned video mixer and thereby to 
reduce pretty expensive hardware. As explained below 
it is also possible to thereby reduce the required mem- 
ory capacity which again makes the CE device cheaper. 
[0004] As depicted in Fig. 1 an MPEG video signal 
consists of a sequence of pictures of intraframe type 11 . 
\2 predicted type P1. P2 and bi-directionaliy pre- 
dicted type B1. B2. B3. B4. B5 

Fig. 2 shows that each picture is formed from macrob- 
locks MB which have a size of 16 lines LI with 16 pixels 
PI each. The picture may consist of 36 rows and 45 col- 
umns of such macroblocks. For some countries a pic- 
ture has 30 rows of macroblocks. The decoding order 
DCO of the macroblocks begins in the top left corner of 
the pictures. 

[0005] According to the invention the picture con- 
tent of an OSD text or graphic is stored in a non-volatile 
memory, e.g. a ROM, in a specific format: the OSD text 
or graphic content is divided into macroblock units and 
the OSD macroblock data are stored in MPEG encoded 
form in said non-volatile memory. Such macroblocks are 
of l-type. 

[0006] Thereby the feature is used that an MPEG 
picture is partitioned into slices as depicted in Fig. 3. 
example slices A to Q, A slice is a series of an arbitrary 
number of consecutive macroblocks. The first and last 
macroblocks of a slice are not skipped macroblocks. 
Every slice contains at least one macroblock. Slices do 
not overlap. The position of slices may change from pic- 



ture to picture. The first and last macroblock of a slice 
are in the same horizontal row of macroblocks. Slices 
occur in the bitstream in the order in which they are 
encountered, starting at the upper-left of the picture and 
5 proceeding by raster-scan order from left to right and 
top to bottom. In the slice header, information is stored 
on the position in the picture the current slice is located. 
Normally, each macroblock in a picture is enclosed in a 
slice. 

10 It is not necessary that the slices cover the entire pic- 
ture, as shown in Fig. 4, example slices A to I. Those 
areas in a specific picture that are not enclosed in a 
slice are not encoded. 

[0007] According to the invention an OSD can have 

15 the shape of a slice, e.g. like slices F. H and/or I in Fig. 
4. In order to display OSDs in an MPEG-decoded pic- 
ture one can decode (with or without the data of the 
macroblocks to be overlaid by the OSD) a video frame 
first and store it in the frame memory. Thereafter a video 

20 frame consisting (only) of the OSD macroblocks is 
decoded using an MPEG decoder, and is written at cor- 
responding address values into that frame memory 
which holds the previously MPEG decoded video frame. 
Then the combined frame memory content is read and 

25 displayed as a complete video picture. 

[0008] The invention has the advantage, that no 
complex hardware like a video mixing device is neces- 
sary for processing OSD data. On one side the memory 
space necessary for OSD purposes is distinctly 

30 reduced due to the fact that the OSD macroblock data 
are stored in compressed form. On the other side it is 
also possible to use high-quality graphic for OSDs due 
to the compressed-format storage. Normally. OSDs 
have a low colour resolution only so that the required 

35 memory capacity is further reduced. 

[0009] It is one object of the invention to disclose a 
method for providing OSD data for OSD display in a 
video signal having an encoded format. This object is 
achieved by the method disclosed in claim 1 . 

40 [0010] It is a further object of the invention to dis- 
close an apparatus which utilises the inventive method. 
This object is achieved by the apparatus disclosed in 
claim 1 1 . 

[0011] In principle, the inventive method is suited 
45 for providing OSD data for OSD display in a video signal 
having an encoded format, wherein the picture content 
of an OSD text or graphic or picture to be displayed is 
stored in that encoded format in a memory and is for the 
purpose of display correspondingly decoded and 
so replaces at the OSD display area the matching area of 
the correspondingly decoded video signal, and wherein 
the encoded format is a format using data reduction. 
Advantageously said data reduction format is the 
MPEG format and the encoded format of said OSD text 
55 or graphic or picture to be displayed are MPEG macrob- 
locks of l-type. wherein the OSD macroblocks to be dis- 
played form at least one MPEG slice. 
[0012] Advantageous additional embodiments of 



2 



<3 



EP 1 014 713 A1 



4 



the inventive method are disclosed in the respective 
dependent claims. 

[0013] In principle the inventive apparatus provides 
OSD data for OSD display in a video signal having an 
encoded format wherein the encoded format is a format 
using data reduction, and includes: 

a memory in which the picture content of an OSD 
text or graphic or picture to be displayed is stored in 
that encoded format: 

means for assembling OSD data to be decoded 
from said memory according to a request from an 
interface: 

decoding means for decoding said video signal and 
for decoding said assembled OSD data for the pur- 
pose of display: 

picture memory means in which pictures of said 
decoded video signal are stored for subsequent 
display and in which at the OSD display area said 
decoded OSD data replace said decoded video sig- 
nal. 

[0014] Advantageous additional embodiments of 
the inventive apparatus are disclosed in the respective 
dependent claims. 

Drawings 

[0015] Embodiments of the invention are described 
with -reference to the accompanying drawings, which 
show in: 

Fig. 1 sequence of pictures of different type; 
Fig. 2 arrangement of macroblocks in a picture; 
Fig. 3 picture with a first partition into slices: 
Fig. 4 picture with a second partition into slices, 

suited for OSD purposes; 
Fig. 5 a decoder with OSD feature; 
Fig. 6 OSD processor in more detail; 
Fig. 7 example of a set of pre-encoded macroblock 

data for a volume bar which are stored in the 

ROM; 

Fig. 8 examples of volume bars displayable with a 
set according to Fig. 7. 

Exemplary embodiments 

[0016] In Fig. 5 an MPEG video input signal MIS is 
fed to an MPEG video decoder MDEC. MDEC interacts 
with a decoder buffer DECB which serves e.g. for col- 
lecting the required input data stream data packets and 
for presenting the decoded data at the correct presenta- 
tion time. The output signal of MDEC is intermediately 
stored in a picture memory, i.e. a frame or field buffer 
FRAB. before being fed to a display DISR A memory 
ROM stores OSD data in a compressed format which 
corresponds to the MPEG macroblock format. Control- 
led by a user interface Ul the OSD data to be displayed 



become selected. Ul may be a remote control or a PC. 
An OSD processor OSDP interacts with Ul. with MDEC 
and with ROM. According to the OSD content desired 
by Ul. OSDP selects the corresponding macroblock 

5 data from ROM, arranges it as a slice or as slices and 
loads these slice data into MDEC, The desired position 
of the OSD data within the pictures is taken from the 
header information of the OSD slices. 
[0017] As shown in Fig. 6, OSDP may include a 

w state control SC. a slice start code generator SSC. a 
macroblock fetcher MBF and a macroblock splicer MBS 
working together to create OSD macroblock slices 
requested by user interface Ul. All blocks within the 
OSDP are under control of the SC which itself interacts 

15 with Ul and gets status information including slice infor- 
mation from MDEC. When beginning the generation of 
an OSD macroblock slice, the MBF takes the slice start 
code from SSC and sends it to MBS. After the slice start 
code, the MBF fetches according to the OSD status dif- 

20 ferent macroblocks from the OSD ROM. These macrob- 
locks are arranged by MBS to generate the final output 
order, e.g. one of the seven volume bar examples of the 
spliced macro patterns depicted in Fig. 8 when using an 
example set of pre-encoded volume bar macroblock 

25 data shown in Fig. 7 which are stored in ROM. The OSD 
slice output data are fed to MDEC. Advantageously, the 
encoded OSD data with horizontally adjacent OSD 
macroblocks form together a slice with only one slice 
start code. As a futher advantage, the encoded OSD 

30 macroblock data can use less bit-consuming DC coeffi- 
cients based on differential DC coefficients. 
The OSD slice is finished in accordance with a new slice 
start code related to the following macro blocks of the 
original picture content. 

35 When the OSD slice content remains unchanged and 
active in the following pictures, it is possible to skip the 
OSD slice macroblocks for the following pictures 
because they are already available in the previously 
decoded picture frame. The related motion vectors are 

-40 zero and the OSD macro-block picture content is 
replaced by the OSD macroblock data already decoded 
with the corresponding initial frame. 
[0018] It is also possible to write the OSD data com- 
ing from OSDP directly into the decoder buffer DECB at 

45 address values required by the decoding order with 
respect to the location of the OSD slices in the picture 
and thereby to prevent decoding of the original picture 
data located at the position of the OSD slices. 
[0019] However, such OSD data insertion is not 

50 possible in case of moving picture content in the MIS 
input signal in the vicinity of the location of the OSD 
slices. 

[0020] In case of special OSD content like e.g. a 
simple bar the length of which correlates with the cur- 
55 rent loudness setting, which can be generated easily as 
a picture content, it may be advantageous to not store it 
in MPEG decoded format in ROM but to generate it sep- 
arately in OSDP and to write it directly into FRAB. 
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[0021] A further advantage of the invention is that 
the decoded picture quality of the OSD display can be 
varied within a wide range according to the desired 
application. E.g. simple messages or symbols can be 
decoded with limited quality (using e.g. coarse inverse 
quantisation) resulting in a faster display, whereas OSD 
pictures can be decoded with high quality (using e.g. 
fine inverse quantisation). 

[0022] For special applications it is also possible to 
generate the encoded OSD data on-the-fly using an 
MPEG encoder, or to load the OSD data from else- 
where, e.g. a separate data carrier or from the Internet, 
whereby the OSD data memory ROM can be a RAM. 
[0023] The invention can be used in connection 
with ISO/IEC standards 11172 (MPEG1). 13818 
(MPEG2). and 14496 (MPEG4). and with other video 
signal coding standards. 

It is also possible to store together with, or instead of, 
the coded video subtitle a corresponding audio "subti- 
tle" or jingle in coded form. This audio code becomes 
decoded and is either mixed with the normal audio 
sound or replaces the normal audio sound for a short 
period of time when the subtitle is displayed or the jingle 
is presented. The audio code can be e.g. MPEG1 Layer 
1 to 3. MPEG2, MPEG2-AAC. MPEG4. AC-3. 
PAC/MPAC/EPAC, DTS. 

Claims 

1 . Method for providing OSD data for OSD display in a 
video signal (MIS) having an encoded format, char- 
acterised in that the picture content of an OSD text 
or graphic or picture to be displayed is stored in that 
encoded format in a memory (ROM) and is for the 
purpose of display (DISP) correspondingly 
decoded (MDEC) and replaces at the OSD display 
area (F - I) the matching area of the correspond- 
ingly decoded (MDEC) video signal, wherein the 
encoded format is a format using data reduction. 

2. Method according to claim 1. wherein said data 
reduction format is the MPEG format and the 
encoded format of said OSD text or graphic or pic- 
ture to be displayed are MPEG macroblocks of I- 
type. and wherein the OSD macroblocks to be dis- 
played form at least one MPEG slice (F. H. I). 

3. Method according to claim 1 or 2. wherein the 
encoded OSD data include horizontally adjacent 
OSD macroblocks which together form a slice (F. H. 
I) with only one slice start code. 

4. Method according to claim 3. wherein the encoded 
OSD macroblock data use less bit-consuming DC 
coefficients. 

5. Method according to any of claims 2 to 4. wherein 
the OSD macroblocks to be decoded in a following 



picture or pictures with the OSD content still active 
are skipped and the related motion vectors are zero 
and the OSD macroblock picture content is 
replaced by the OSD macroblock data already 
5 decoded with the corresponding initial frame. 

6. Method according to any of claims 1 to 5. wherein 
said memory (ROM) is a non-volatile memory e.g. 
a ROM. 

10 

7. Method according to any of claims 2 to 6. wherein 
the OSD macroblocks to be decoded become 
assembled according to the request from an user 
interface (Ul). 

15 

8. Method according to any of claims 1 to 7, wherein 
said replacement in said area (F - I) of the corre- 
spondingly decoded (MDEC) video signal with said 
decoded OSD data is carried out in a picture mem- 

20 ory (FRAB) the content of which is to be displayed. 

9. Method according to any of claims 3 to 8. wherein in 
case of special OSD content like e.g. a simple bar 
the required OSD data is not stored in said picture 

25 memory (ROM) but is generated separately 

(OSDP) and is written directly into said picture 
memory. 

10. Method according to any of claims 1 to 9. wherein in 
30 addition encoded audio data are stored in said 

memory (ROM) and are selected and decoded in 
connection with said OSD data. 

11. Apparatus for providing OSD data for OSD display 
35 in a video signal (MIS) having an encoded format 

wherein the encoded format is a format using data 
reduction, and including: 

a memory (ROM) in which the picture content 
40 of an OSD text or graphic or picture to be dis- 

played is stored in that encoded format; 
means (OSDP) for assembling OSD data to be 
decoded from said memory according to a 
request from an interface (Ul); 
45 - decoding means (MDEC) for decoding said 

video signal and for decoding said assembled 
OSD data for the purpose of display (DISP); 
picture memory means (FRAB) in which pic- 
tures of said decoded video signal are stored 
so for subsequent display and in which at the OSD 

display area (F - I) said decoded OSD data 
replace said decoded video signal. 

12. Apparatus according to claim 11. wherein said data 
55 reduction format is the MPEG format and the 

encoded format of said OSD test or graphic or pic- 
ture to be displayed are MPEG macroblocks of I- 
type. and wherein the OSD macroblocks to be dis- 
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played form at least one MPEG slice (R H, I). 

13. Apparatus according to claim 11 or 12, wherein 
said memory (ROM) is a non-volatile memory, e.g. 
a ROM. 5 
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